(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
5 June 2003 (05.06,2003) 




(10) International Publication Number 

PCT WO 03/046708 Al 



(51) International Patent Classification 7 : G06F 3/033, 
G06K 11/08 

(21) International Application Number: PCT/SE02/02200 

(22) International Filing Date: 

29 November 2002 (29.11.2002) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 

0104041-9 30 November 2001 (30.1 1.2001) SE 

(71) Applicant (for all designated States except US): ANOTO 
AB [SE/SE]; Scheelevagen 19 C, S-223 70 Lund (SE). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): BRYBORN, Mat- 
tias [SE/SE]; Karl XII gata 16 A, S-222 20 Lund (SE). 



SANDSTR6M, Ola [SE/SE]; Karl XI gatan 3 A, S-222 
20 Lund (SE). 

(74) Agent: AWAPATENT AB; Box 5117, S-200 71 Malmo 
(SE). 

(81) Designated States (national): AE, AG, AL, AM, AT (util- 
ity model), AT, AU, AZ, BA, BB, BG, BR, BY, BZ, CA, 
CH, CN, CO, CR, CU, CZ (utility model), CZ, DE (util- 
ity model), DE, DK (utility model), DK, DM, DZ, EC, EE 
(utility model), EE, ES, Fl (utility model), FI, GB, GD, GE, 
GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, 
LC, LK, LR, LS, LT, LU, LV, MA. MD, MG, MK, Mn! 
MW, MX, MZ, NO, NZ, OM, PH, PL, PT, RO, RU, Sc] 
SD, SE, SG, SI, SK (utility model), SK, SL, TJ, TM, Tn! 
TR, TT, TZ, UA, UG, US, UZ, VC, VN, YU, ZA, ZM, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, BG, CH, CY, CZ, DE, DK, EE, 

[Continued on next page J 



(54) Title: ELECTRONIC PEN AND METHOD FOR RECORDING OF HANDWRITTEN INFORMATION 



< 
O 




(57) Abstract: An electronic pen (10) for recording of 
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and a memory. The control unit registers pen movements 
across at least one base (2, 2'), stores a plurality of digital 
pen strokes (1, V) in the memory as a function of said 
movements, and supplies a set of the digital pen strokes for 
processing. The digital pen strokes include a first type (1), 
which is processed as graphical information constituting 
the information to be recorded, and a second type (I*), 
which is processed as instructions for the processing of 
digital pen strokes of the first type. The electronic pen 
also has session-determining means adapted to detect 
a current working session of the pen. The control unit 
(16a) indicates, for the processing of the set of digital 
pen strokes (I, 1'), the working session during which the 
respective digital pen strokes have been input 
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ELECTRONIC PEN AND METHOD FOR RECORDING 
OF HANDWRITTEN INFORMATION 



Technical Field 

The present invention relates to electronic record- 
ing of handwritten or hand-drawn information by means of 
an electronic pen which is moved in desired pen movements 
across at least one base. More particularly, the inven- 
tion relates to such electronic recording in which the 
pen movements are registered as a plurality of digital 
pen strokes that are either of a first type, which is 
intended to be processed as graphical information 
constituting the information to be recorded, or a second 
type, which is intended to be processed as instructions 
for the processing of digital pen strokes of the first 
type . 

Background Art 

Input systems for inputting handwritten or hand- 
drawn graphical information into a computer are widely 
used together with different types of graphics software, 
for example CAD programs or web design programs. These 
input systems include a drawing device, and also a base 
or support for the latter. The drawing device can con- 
sist of an electronic pen which is intended to be held 
in a user's hand and is moved in desired pen movements 
across the base for inputting graphical information, 
such as handwriting, drawings, geometric figures, graphi- 
cal patterns, symbols, numbers or the like. WO 01/71473 
describes the use of such an electronic pen. 

In this connection it is desirable to increase the 
user's possibilities of acting on the appearance of the 
graphical information produced or on other properties 
associated with the graphical information. Thus , in many 
applications it is necessary, or at least expedient, for 
the user to be able to specify purely graphical proper- 
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ties such as line thickness, line color, and the choice 
between solid, broken or dotted lines. The selectable 
properties for the graphical information can also be of 
a more advanced character, for example properties which 
allow the graphical information to look as if it has been 
produced by a special pen, such as a calligraphy pen, or 
by means of an airbrush technique. The selectable proper- 
ties can also concern whether certain graphical informa- 
tion is intended to be visible or invisible or can simply 
indicate that particular information is intended to be 
read only by a certain recipient or group of recipients. 

There are traditional ballpoint pens with which it 
is possible to write with ink in different colors. Such 
multicolor pens comprise a set of buttons which are 
arranged on the pen and are used to select the desired 
color. It would be obvious to transfer this principle 
of choice of properties to electronic pens too. However, 
this has the disadvantage that the user usually has to 
change grip in order to be able to access the button 
which is to be depressed to obtain a desired property 
(e.g. color). A further disadvantage' of this solution 
is that the number of buttons which it is possible to 
incorporate on a pen is limited. 

The problem of being able to make a large number 
of selections using a limited number of buttons has of 
course been solved in other types of handheld electronic 
appliances, for example mobile phones, by introducing 
screen-based menu systems. However, the narrow and elon- 
gate shape of an electronic pen can only provide a small 
accessible area for a display, and hence a menu system 
solution is less suitable for this type of product. A 
menu system would in any case not represent an optimum 
user interface for a pen because the user has to move or 
turn the pen round in order to be able to view the 
display and access the operating buttons for the menu 
system. 

A better way of making it possible for the user to 
select a property from among a large number of proper- 
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ties without substantially changing his grip on the pen 
is instead to use a property palette placed on the base, 
that is to say an area comprising partial areas or selec- 
tion fields, the meaning of which is pre-defined in the 
pen. For example, a certain selection field in the 
palette can signify the color red, and the pen stores the 
subsequent input with the color red property. 

The advantage of this procedure is that it resembles 
an intuitive method of producing graphical information, 
but the solution has a serious disadvantage in its lack 
of flexibility. When the definitions of different selec- 
tion fields have been programmed into a pen, it is diffi- 
cult to increase the number of properties because the 
pen's memory is limited. In addition, changing the defi- 
nition of a certain property requires reprograraming of 
the pen, and, if several different palettes are to be 
used, extensive and regular reprogramming of the pen is 
required, which complicates the construction of the pen. 

In a more flexible solution, instead of storing the 
meaning of each pen stroke in the electronic pen, all 
definitions and interpretations of pen strokes on 
palettes and also on conventional writing surfaces are 
handled in a remote server with which the pen can com- 
municate. The advantage of this solution is that it is 
much easier to reprogram a server for interpretation of 
certain properties than to reprogram a large number of 
pens . 

The solution indicated in the previous paragraph is 
described in more detail in WO 01/71473 which relates to 
an arrangement for inputting graphical information into 
a computer system, the graphical information arising when 
a drawing device is moved in relation to a base which is 
provided with a position-coding pattern. The drawing 
device is arranged to record positions on the base, and 
a computer system connected to the pen is arranged to 
interpret position information from a first area as gra- 
phical information, and position information from a 
second area as control information concerning a visual 
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property of the graphical inf ormation. Examples of such 
properties are line thickness and line color. 

The inventors of the present invention have now rea- 
lized that there is a problem with a solution according 
to the previous paragraph: when a user of an electronic 
pen with selectable properties begins a new session of 
producing graphical information by means of the pen, said 
user cannot always remember the most recently selected 
settings from the most recently preceding writing ses- 
sion. This can happen, for example, in cases where a long 
period of time has elapsed since the last time the elec- 
tronic pen was used. 

An intuitive solution to this problem would be to 
provide the user with feedback concerning the selected 
properties via a user interface on the pen. However, 
because of the desired configuration of an optimum elec- 
tronic pen, especially given the requirement for a low 
weight and an elongate shape for user-friendly handling, 
and also given the requirement in respect of a low price, 
the possibilities of constructing a user interface are 
limited. In addition, any property settings would either 
need to be stored locally in some way in the pen (which 
is not desirable for the above reasons) or transferred to 
the pen from the server. 

The inventors of the present invention have also 
realized that there is another problem associated with 
the fact that it is often advantageous to provide the 
writing support in an arrangement like a book, file or 
notepad, where a number of "empty" input pages of paper 
are supplemented with a property palette which is either 
printed on a separate page of paper or on a special part 
of the input pages. A property selection on the palette 
page can and will then affect all subsequent inputs on 
the input pages, regardless of which page this takes 
place on. It is necessary in this connection to transfer 
all pen strokes input on the palette page to the server 
so that the latter is able to process (render) the pen 
strokes on the input pages in the correct way. This pro- 
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cedure can therefore involve transmitting large amounts 
of information on pen strokes from the palette page to 
the server, and this in turn has disadvantages in terms 
of long transmission times, costs associated with these 
long transmission times, high power consumption in the 
pen, and the need for large storage capacity in the 
server. 

Summary of the Invention 

An object of the invention is to solve the above - 
described problems of recording graphical information 
by means of an electronic pen. A particular object of 
the invention is to make available a common solution to 
the various and apparently completely different problems 
which have been discussed above. 

These objects are achieved with an electronic pen; 
a system and a method for electronic recording of hand- 
written or hand-drawn information; a method for process- 
ing such handwritten or hand-drawn information; a compu- 
ter program product; and use of an electronic pen in 
accordance with the appended independent claims. 

A first aspect of the invention is therefore an 
electronic pen for recording of handwritten or hand- drawn 
information, comprising a control unit and a memory. The 
control unit is arranged to register pen movements across 
at least one base, to store a plurality of digital pen 
strokes in the memory as a function of said movements, 
and to supply a set of the digital pen strokes for 
processing. The digital pen strokes include a first type, 
which is intended to be processed as graphical informa- 
tion constituting said information to be recorded, and a 
second type, which is intended to be processed as in- 
structions for the processing of digital pen strokes of 
the first type. The electronic pen further comprises 
session-determining means adapted to detect a current 
working session of the pen. The control unit is arranged 
to indicate, for the processing of said set of digital 
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pen strokes, the working session during which the 
respective digital pen strokes have been input. 

Such a pen makes it possible to solve the above- 
described problems, namely of ensuring that a user of an 
electronic pen with selectable properties cannot always 
remember the most recently selected settings of the pen. 
By way of detecting, according to the invention, the 
different working sessions during which the different 
digital pen strokes have been input, it is possible, in 
the subsequent processing of the registered pen strokes, 
to automatically restore the pen's settings to an initial 
or default state as soon as it is identified that a 
change-over between working sessions has taken place. 
This has the great advantage that the person using the 
pen does not have to worry about how the pen settings 
appeared during the preceding working session; in the 
subsequent processing, the pen settings are at all times 
considered as having been reset to the initial or default 
state at the start of a new working session. 

The registered pen strokes may either be transmitted 
to a remote processing device, such as a server, for 
processing therein, or be processed by local processing 
means in the pen. In the former case, the pen will 
comprise a transmitter for communication with the remote 
processing device. In the latter case, the local pro- 
cessing means may be implemented as software code exe- 
cuted by the control unit. A combination of these alter- 
natives is also possible, such that the pen will contain 
one instance of a (local) processing device (implemented 
by said local processing means) and also communicate with 
a second (remote) instance of a processing device. 

With a pen as described above it is also possible to 
solve the problem of avoiding unnecessary transmission 
and/or processing of information concerning the selection 
of pen stroke properties. For this purpose, with regard 
to transmission to a remote processing device or pro- 
cessing locally in the pen as the case may be, the 
control unit in the pen is arranged to cause only such 
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digital pen strokes of the second type to be processed, 
which originate from working sessions for which there are 
digital pen strokes of the first type included in said 
set . . 

The pen can advantageously comprise a session coun- 
ter which is stored in the memory and which is increment- 
ed by the control unit when the session-determining means 
has detected that a new working session has been initiat- 
ed, wherein the control unit stores the digital pen 
strokes together with the session counter values applying 
at the time of input of the respective pen strokes, and 
wherein the control unit is arranged to use these values 
when determining which digital pen strokes of the second 
type are to be processed. 

The control unit can alternatively be arranged to 
note the times at which new working sessions are initiat- 
ed, to store these times and to use them when determining 
which digital pen strokes of the second type are to be 
processed. 

The session- determining . means can comprise a mecha- 
nical, optical, electrical or magnetic switch which is 
connected to said control unit. In the case where the pen 
comprises not only a pen body but also a protective cap,- 
the switch can advantageously be placed so as to detect 
that the protective cap is removed from the pen body. 

Said second type of digital pen strokes may repre- 
sent at least one property of said first type of digital 
pen strokes. Such a property may be a visual graphic pro- 
perty such as color, thickness, pattern or visibility. It 
may also be a temporal or spatial resolution for the pen 
strokes - either the resolution with which the pen 
strokes are registered or the resolution with which they 
are to be rendered during processing. The property may 
also relate to a background for the pen strokes; it may 
for instance designate a certain background image, 
pattern or color, It may even relate to a property of the 
background itself, for instance whether pen strokes are 
to act in an overwriting manner or an erasing manner. 
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Furthermore, the property may relate to a context to 
which the pen or its user belongs, such as a certain 
user, group, company, shop, book, etc. The property may 
also be an indication of restricted access to the pen 
strokes. As used herein, "indication of restricted 
access" may mean limited or full access for a reader to 
pen strokes which would otherwise be less accessible, or 
not accessible at all, had said indication not been 
given. "Indication of restricted access" may also mean 
less access to pen strokes than if said indication were 
not given. 

Moreover, said second type of digital pen strokes 
may represent at least one command for affecting an 
interpretation of digital pen strokes of said first type. 
Such interpretation may involve character recognition, 
wherein said command causes a plurality of pen strokes to 
be interpreted in a specified manner, for instance as a 
text, a sequence of characters, a sequence of digits 

(such as a telephone number or bank account) , a sequence 
of upper-case characters, a sequence of lower-case 
characters, or an address for electronic communication 

(such as email) . The command may also serve to define a 
certain page format parameter such .as page break, page 
column or page margin. 

Alternatively, the interpretation may involve geo- 
metrical object recognition, wherein said command causes 
a plurality of pen strokes to be interpreted in a speci- 
fied manner, for instance to be matched with an ideal 
geometrical shape such as a circle or a polygon. 

As yet an alternative, the second type of digital 
pen strokes may represent a command to the processing 
means/remote processing device itself, for instance to 
"manually" reset the pen settings to an initial or 
default state by commanding a new working session. 

A second aspect of the invention is a system for 
electronic recording of handwritten or hand-drawn infor- 
mation, comprising an electronic pen which is intended 
to be moved in desired pen movements across at least one 



ISDOCID: <W0 03046708A1_I_> 



BNS page 10 



WO 03/046708 PCT/SE02/02200 



base and to register the pen movements as a plurality of 
digital pen strokes, and a processing device for receiv- 
ing registered digital pen strokes from the electronic 
pen, the digital pen strokes including a first type and a 
second type as stated above. In the same way as in the 
first aspect, the electronic pen comprises session-deter- 
mining means adapted to detect a current working session 
of the pen. Upon transmission of the digital pen strokes 
to a processing device, the pen is arranged to indicate 
during which working session the respective digital pen 
strokes have been input. Upon processing of the digital 
pen strokes, the processing device is arranged to detect 
that a certain digital pen stroke is indicated as having 
been input during a different working session than a 
preceding digital pen stroke and, as a consequence of 
this, to restore the property for successive digital pen 
strokes of the first type to an initial or default state. 
As used herein, "a preceding digital pen stroke" may be 
an earlier registered pen stroke or an earlier processed 
pen stroke . 

A third aspect of the invention is a method for 
recording of handwritten or hand-drawn information origi- 
nating from an electronic pen as stated above. The method 
comprises the steps of 

a) detecting the working session of the pen during 
which the respective digital pen strokes are recorded, 

b) determining the working session (s) during which a 
plurality of digital pen strokes of said first type were 
recorded; and 

c) supplying for processing only such digital pen 
strokes of said second type which have been recorded 
during the working session(s) determined in step b) . 

A fourth aspect of the invention is a method for 
processing of handwritten or hand-drawn information of 
the above-mentioned types. According to this method, a 
set of recorded digital pen strokes are processed as 
follows : 
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a digital pen stroke of the second type determines a 
current property of digital pen strokes of the first 
type; 

digital pen strokes of the first type are assigned 
the current property; and 

if a certain digital pen stroke is indicated as hav- 
ing been recorded during a different working session of 
the electronic pen than a preceding digital pen stroke, 
the current property is reset to an initial or default 
state . 

A fifth aspect of the invention is a computer pro- 
gram product which can be directly loaded into a memory 
belonging to a processor and which comprises program code 
for carrying out the steps according to the fourth aspect 
of the invention. 

A sixth aspect of the invention consists in use of 
an electronic pen according to the above for defragment- 
ing or so-called garbage collection of the pen's memory. 

The second to sixth aspects of the invention have 
essentially the same advantages as the first aspect. 

Other objects, advantages and features of the inven- 
tion are set out in the following detailed description 
of the invention, in the attached claims and in the draw- 
ings . 

Brief Description of the Drawings 

The invention will now be described in more detail 
with reference to the accompanying drawings, in which 

Fig. 1 is a schematic overview of a system for elec- 
tronic recording of handwritten or hand-drawn information 
according to an embodiment comprising.^ inter alia, an 
• electronic pen and a server for receiving graphical 
information input from the pen, 

Fig. 2 is a schematic view of the electronic pen in 
Fig. 1, 

Fig. 3 is a schematic view of a position-coding pat- 
tern which is applied on the writing bases for the elec- 
tronic pen in Fig. 1, 
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Fig. 4 shows the block diagrams of the electronic 
pen and server in Fig, 1, and 

Figs 5 and 6 are flow charts of possible operating 
methods for the invention. 

Detailed Description of the Invention 

An overview of the various components of the inven- 
tion will first be given. This will be followed by a 
detailed account of those aspects which may be central to 
the invention . 

* * * 

A preferred embodiment of a system for electronic 
recording of handwritten or hand- drawn information is 
shown in Fig. 1. The system uses an electronic pen 10 
which will be described in more detail with reference to 
Figs 2 and 4. When the user moves the pen 10 in desired 
pen movements 1 across a writing base, the pen movements 
are recorded as a plurality of digital pen strokes which 
are stored locally in the pen in order to await subse- 
quent transmission to a server 5 via a wireless communi- 
cation link 4. To permit this recording, the writing base 
is provided with a position-coding pattern 20 which will 
be described in more detail with reference to Fig. 3. One 
possible application, among a large number of such appli- 
cations, is one in which the graphical information input 
via the pen movements 1 is added to or enclosed with an 
e-mail message 6 which is transmitted via a wide area 
network 7 (WAN) , for example the Internet, to a receiving 
computer 8 nominated by the person using the pen. For 
this purpose, the server according to Fig. 4 comprises 
a main processor (CPU) 27, a working memory (RAM) 28 con- 
nected thereto, a secondary memory 29, a transceiver 2 6 
for wireless communication with the pen 10 via the link 
4, and a WAN interface 30 (for example a network card 
and/or other necessary equipment to be connected to the 
wide area network 7) . In addition to storing the normal 
operating system, the secondary memory 2 9 also stores 
application software consisting of a set of program 
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instructions which, when loaded into the working memory 
28, can be executed by the main processor 2 7 in order 
to carry out the methods according to the invention 
described below. 

In the preferred embodiment shown in Fig. 1, the 
writing base for the pen 10 is in the form of an arrange- 
ment similar to a book, file or notepad and is divided 
into, on the one hand, a number of initially empty input 
pages 2 of paper and, on the other hand, a property 
palette 3 which in this case is printed on a separate 
page of paper 2' but could alternatively appear in a 
special partial area on the input pages. By making a pen 
stroke 1' in one of the partial fields 3a-c in the pro- 
perty palette 3, the user can select the desired proper- 
ty for subsequent "normal" pen strokes 1 on the input 
pages 2 . 

The properties that can be selected using the 
palette 3 can include, inter alia, purely stylistic pro- 
perties for the graphical input 1, such as line thick- 
ness, line color or pattern (e.g. choice between solid, 
broken or dotted lines) . The selectable properties can 
also include more advanced properties, for example those 
which make the graphical information look as if it has 
been produced using a special pen such as a calligraphy 
pen or by an airbrush technique. The properties can also 
concern whether certain graphical information is to be 
visible or not visible, or alternatively can indicate 
that the information in question is intended to be read 
only by a specific recipient or group of recipients. 

In this embodiment, the digital pen strokes recorded 

with the aidL of_the .electronic pen 10 can therefore in 

summary, be of a first type (normal pen strokes 1) which 
will be processed by the server as purely graphical 
information, and a second type (property- selecting pen 
strokes 1') which will be processed by the server as an 
indication of a property of the digital pen strokes of 
the first type. An input system substantially 
corresponding to that in Fig. 1 is described in detail in 
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WO 01/71473, which in its entirety is incorporated herein 
by reference . 

Referring to Fig. 2, a brief description will now be 
given of the general component parts of the electronic 
pen 10. A more complete description of the pen 10 is 
given in WO 01/16691, WO 01/26032 and WO 01/26033, which 
in their entirety are incorporated herein by reference. 

The electronic pen 10 has a casing or pen body li 
which has approximately the same design as the casing of 
a conventional highlighter pen. One short side of the 
casing has a window 12 through which images are recorded. 
The casing 11 principally comprises an optics part, an 
electronics part and a power source. 

The optics part comprises at least one illuminating 
light source 13, a lens system (not shown in the figure), 
and an optical image sensor 14. The light source 13, pre- 
ferably a light -emit ting diode, preferably uses infrared 
light, or alternatively light of another wavelength, to 
illuminate a part of the base 2 which lies within sight 
of the window 12. The base 2 is provided with the posi- 
tion-coding pattern 20. An image of the base 2 will be 
projected via the lens system onto the image sensor 14. 

The power source for the sensor device 10 is advan- 
tageously a battery 15, which alternatively can be 
replaced by or supplemented by mains power (not shown) . 

The electronics part 16 comprises a control unit 16a 
with a storage means 16b connected to it. The control 
unit 16a is responsible for the various functions of the 
electronic pen 10 and can advantageously be implemented 
using a commercially available micro-processor such as a 
central processing unit (CPU) , a digital signal processor 
(DSP) or another programmable logic device such as an 
FPGA, or alternatively an application- specif ic integrat- 
ed circuit (ASIC) , as discrete analog and digital compo- 
nents, or a combination of the above. 

The storage means 16b preferably comprises diffe- 
rent types of memories such as a working memory (e.g. a 
RAM) and a program code and persistent storage memory 



ISDOCIO: <WO 03046708A1_I_> 



BNS page 15 



WO 03/046708 



14 



PCT/SE02/02200 



(e.g. a flash memory). Associated programs are stored in 
the storage means 16b and executed by the control unit 
16a in order to carry out the functions of the electronic 
pen 10. 

A conventional pen point 17 is arranged on the cas- 
ing 11. With the pen point 17, the user can write or draw 
physically (visually) on the base 2 by means of a 
conventional pigment-based marker fluid being deposited 
on the surface. The marker fluid in the pen point 17 is 
preferably transparent to infrared light in order to 
avoid interference with the opto-electronic detection in 
the electronic pen 10. 

The electronics part additionally comprises a com- 
bined transmitter and receiver (transceiver) 18 for 
transfer of information to or from a remote apparatus, 
such as a computer or mobile phone, but mainly for 
information transfer to the server 5. The combined 
transmitter and receiver 18 is advantageously adapted for 
short-range radio communication in accordance with the 
Bluetooth standard at 2.4 GHz on the ISM (Industrial, 
Scientific and Medical) frequency band. However, the 
combined transmitter and receiver can alternatively be 
adapted for infrared communication, such as IrDA (Infra- 
red Data Association) , or for cable-based communication 
(such as USB or RS232) , or basically for any other avail- 
able standard for short-range communication between a 
handheld device and a remote device. 

Although the information transfer in the preferred 
embodiment takes place directly between the pen 10 and 
the server 5, it should be noted that this can just as 
well take place via an intermediate device, for example 
a mobile phone, a hand-held computer or a portable PC. 
In this case, the intermediate device is provided with a 
combined transmitter/receiver corresponding to the trans- 
mitter/receiver 18 in the pen 10, and information can be 
transferred from the pen to the intermediate device. The 
latter is further provided with a suitable interface for 
communication with the server 5, for example a network 
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card (for communication via a local or wide area net- 
work) , or alternatively an analog or digital modem (for 
communication via a cable-based fixed telecommunications 
network, a mobile telecommunications network or a satel- 
lite telecommunications network) . In this way, the infor- 
mation from the pen can be conveyed onwards to the server 
5 by this intermediate device. 

In addition, the electronics part can comprise but- 
tons 19a by means of which the user can control the func- 
tions of the electronic pen 10. The electronic pen 10 can 
also include a screen 19b, such as a liquid crystal dis- 
play, and a status-indicating light 19c. 

Referring to Fig. 3, the position- coding pattern 
comprises a virtual raster pattern 21 about which a num- 
ber of marks 2 2 are formed. Each mark represents one of 
four possible values from 1 to 4 . The value of each mark 
is represented by its actual position 22 in relation to 
its nominal position 23, the latter being at the inter- 
section between a horizontal line and a vertical line in 
the raster pattern 21. Thus, each mark 22 can be situated 
in one of four different positions which are separate 
from each other in orthogonal directions from the nominal 
position 23. The distance is preferably not less than 1/8 
and not more than 1/4, preferably 1/6 , of the distance 
between two opposite raster lines. 

The distance between the raster lines can, for exam- 
ple, be 30 0 micrometers or 254 micrometers. The latter 
distance is especially suitable for printers and image 
sensors which often have a resolution which is a multiple 
of 100 dpi (dots per inch) . 

Each mark 22 consists of a substantially circular 
dot having a radius which is preferably between 25% and 
12 0% of the distance between the dots and the nominal 
position 23. Alternatively, the marks 22 can have geome- 
tric shapes which are other than circular, for example 
rectangular, triangular or elliptic, and they can also be 
solid or open. 
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The position-coding pattern 2 0 can be constructed in 
such a way that it codes a very large number of absolute 
positions. For example, 6x6 contiguous markings in com- 
bination can code a position with x and y coordinates. 
By providing the surface of the base 2 with the position- 
coding pattern 2 0 , an electronic representation of the 
information written or drawn on the base can be obtained 
by the electronic pen 10 by means of repeatedly producing 
images of the surface when the pen 10 is moved across the 
surface. In these images, the marks 22 will appear as 
foreground objects, while the rasters 21 are only virtual 
and will not appear in the images. 

Position-coding patterns of the type outlined above 
are described in more detail in WO 01/16691, WO 01/26032 
and WO 01/26033. An alternative position- coding pattern 
is shown in WO 00/73983. All these documents are incorpo- 
rated in their entirety herein by reference. 

* * * 

To achieve the objects of the invention, the elec- 
tronic pen 10 has been provided with session-determining 
means for detecting a current working session of the pen 
and for saving information about the current working 
session together with the input graphical information 1, 
1'. As can be seen from Fig. 4, in the preferred embodi- 
ment this session-determining means is realized as a sen- 
sor 24 for detecting the switching on/off of the pen 10, 
in combination with a session counter 25 and general con- 
trol from the control unit 16a. The sensor 24 is advan- 
tageously a mechanical, optical, electrical or magnetic 
switch with the aid of which a well-defined event can be 
detected, for example the user ^switching _on/activating 
the pen by means of a button 19a provided for this 
purpose . 

In the preferred embodiment, however, the sensor 24 
is arranged to detect when a protective cap (not shown) 
on the short side 12 of the pen is removed from said pen 
in order to start a new writing session. In this case, 
the sensor 24 can advantageously be realized by a Hall- 
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effect element or another element susceptible to magnetic 
fields which is able to detect the presence (when the 
protective cap is placed on the pen, which then assumes a 
switched of f /deactivated state) and the absence (when the 
protective cap is removed from the pen, which is then 
switched on/activated) of a magnet placed in the protec- 
tive cap. A suitable sensor for the above purpose is 
described in Applicant's published International Patent 
Application WO 02/093467 which in its entirety is 
incorporated herein by reference. 

Each time the control unit 16a detects via the sen- 
sor 24 that the pen has been switched on/activated prior 
to a new working session (for example, by the user remov- 
ing the protective cap from the pen) , the control unit 
will increment the value of the session counter 25. In- 
the preferred embodiment, the session counter 25 can 
represent a 32-bit number, which is a very high number in 
this context; in the unlikely event of the user switching 
the pen on as much as once a second, the session counter 
25 will overflow only after approximately 136 years. 

After recording, all the digital pen strokes stored 
in the memory 16b (normal pen strokes 1 and property pen 
strokes 1') will be stored together with the current 
value of the session counter 25. More particularly, in 
the preferred embodiment, the following storage format 
for pen strokes is used: 

Pen stroke header -> Offset -> Start time -> Page 
address -> Session counter -> [coordinate stream], where: 

Pen stroke header includes miscellaneous control 
information for error handling, storage format, data 
compression and the like; 

Offset provides a value of the length, in number of 
bits, of the current pen stroke in relation to the start 
of the next pen stroke; 

Start time is self-explanatory and can be given 
either as an absolute value or as a difference value in 
relation to the preceding start time; 
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Page address ensures that each pen stroke is unambi- 
guously allocated to an individual base 2/2' in a pos- 
sibly hierarchical structure of pages; 

Session counter is the current value of the session 
counter 25 , expressed as an absolute or differential 
(relative) number; and 

[coordinate stream] represents the information load 
(payload) and comprises a sequence of absolute or rela- 
tive-coded x and y coordinates for sampled positions of 
movements of the pen, i.e. pen strokes 1/1' , on the base 
2/2' . 

According to the invention, all recorded pen strokes 
are thus allocated to a certain working session of the 
pen 10, represented by the value of the session counter 
2 5 applying at each time. The fact that the working ses- 
sion is known for all stored pen strokes is then made use 
of in order to achieve the object of the invention, as 
will be described in detail below. More particularly, 
session allocation is used, on the one hand, to minimize 
the necessary transmission of property- selecting pen 
strokes 1' to the server 5, and, on the other hand, to 
obtain automatic resetting of selected pen properties in 
the case where a new working session has been started. 

Fig. 5 illustrates a procedure for transmission of 
recorded pen strokes from the pen 10 to the server 5 . In 
an initial step 41, the transmission procedure is ini- 
tiated by an active measure on the part of the user, for 
example by the latter using the pen 10 to cross or tick 
off a special SEND field on the current base 2 and/or 
ordering transmission using one of the buttons 19a. 
Alternatively, the transmission could be initiated auto- 
matically, for example when a predetermined period of 
time has passed since a pen stroke was last input, or 
when the memory 16b in the pen 10 has reached a certain 
degree of filling. Step 41 is ended by the pen 10 sending 
a transmission request to the server 5 via the wireless 
link 4 . 
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As a result of this, the server 5 in step 42 orders 
transmission of a certain input page X, normally the page 
on which the user marked the SEND field. 

In step 43, the control unit 16a in the pen 10 goes 
through all the normal pen strokes 1 stored in the memory 
16b and compiles the normal pen strokes which belong to 
the current input page X. At the same time, the control 
unit 16a notes which session counter values appear for 
the compiled normal pen strokes 1. The control unit 16a 
either saves a complete list of all the occurring session 
counter values or registers their minimum and maximum 
values. Moreover, the control unit 16a preferably sorts 
the compiled normal pen strokes 1 into chronological 
order (according to the Start time parameter in the 
storage format) before the compiled pen strokes are 
transmitted to the server 5 at the end of step 43. 

In step 44, the server then requests transmission of 
the property-selecting pen strokes 1' which are stored, on 
the property page/palette page Y (i.e. the base 2' and 
the palette 3 in Fig. 1) and which are needed for subse- 
quent processing/rendering of the normal pen strokes 1 on 
the input page X. Steps 43 and 44 may alternatively be 
performed in the opposite order. 

Since the property page/palette page Y probably also 
contains property- selecting pen strokes 1' for other in- 
put pages 2 than just page X, according to the invention 
the relevant property- selecting pen strokes are extracted 
in the manner described below. 

From all the property-selecting pen strokes 1' stor- 
ed in the memory 16b, the control unit 16a in the pen 10 
now chooses, in step 45, only those property-selecting 
pen strokes which have the same value, of the Session 
counter parameter, as one of the normal pen strokes 1 
compiled in step 43, or chooses those property- selecting 
pen strokes which have a session counter value that falls 
within a range defined by registered minimum and maximum 
values, as the case may be. It is of course these 
property- selecting pen strokes alone which are needed for 
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the subsequent processing/ rendering, in the server 5, of 
the normal pen strokes 1 on the input page X. This 
results in a considerable reduction in the transferred 
data volume, in a subsequent step 46, compared with the 
situation if all the property-selecting pen strokes 
stored in the memory 16b were to be transmitted. 

In step 47, the procedure moves on to the subsequent 
processing/rendering of the transmitted pen strokes. This 
subsequent processing/rendering takes place exclusively 
in the server 5 and is illustrated in Fig. 6. 

In an initial step 51, a common, chronological 
list of the transmitted normal pen strokes and property- 
selecting pen strokes is formed. The rendering proper- 
ties, for example line thickness, color, etc., which are 
to be applied by the server 5 to the normal pen strokes, 
are reset in step 52 to an initial or default state. 
Thereafter, a main loop is started in step 53 . As long as 
there are pen strokes remaining in the list formed in 
step 51, the following takes place: 

The uppermost (chronologically the first) pen stroke 
is read from the list in step 54. In step 55, a check is 
made to ascertain whether the Session counter parameter 
for this pen stroke has a higher value than for the last 
processed pen stroke. If so, this means that a new work- 
ing session of the pen 10 was initiated between the 
recording of the most recent pen stroke and the current 
pen stroke, for which reason, in accordance with the pre- 
vious discussion, the rendering properties have to be 
reset to an initial or default state in step 56. The 
initial or default state for the rendering properties 
can, for example, comprise "black color; normal line 
thickness; solid line". 

If the response in step 55 is negative, the execu- 
tion moves on directly to a new decision step 57 in which 
a check is made to ascertain whether the current pen 
stroke is a property- selecting pen stroke. If such is the 
case, this property- selecting pen stroke is analyzed in 
more detail in step 58. By comparing with pre-defined 



NSDOCJD: <WO 03046708A1 J_> 



BNS page 22 



• WO 03/046708 



21 



PCT/SE02/02200 



templates which can either be stored directly in the 
server's secondary memory 29 or can be obtained via the 
wide area network 7, the server 5 establishes the meaning 
of the partial field 3a-3c in the palette 3 on property 
page 3 in which the property- selecting pen stroke in 
question was made. The rendering properties are then 
changed in accordance with the established meaning; 
if the meaning of a particular partial field 3a is 
n color=red" , the rendering properties are changed with 
respect to color, so that subsequent normal pen strokes 
are rendered in (i.e. giveh) the color red. 

If the response in decision step 57 is negative, 
i.e. the current pen stroke is not a property-iselecting 
pen stroke but instead a normal pen stroke, this normal 
pen stroke is rendered in a subsequent step 59 with the 
current rendering properties. 

Finally, the pen stroke whose processing has now 
been finished may be deleted from the list or simply left 
as it is, and then the execution returns to step 53. 

An alternative embodiment will now be described in 
brief . Instead of the session-determining means being a 
session counter 25 which is incremented each time a new 
working session is detected by the sensor 24, the control 
unit 16a in the pen 10 records on each occasion the time 
at which a new working session is detected. These times 
can be stored in a, possibly circular, reset list of 
intended resetting events . 

Upon transmission of recorded pen strokes to the 
server 5, the control unit 16a in the pen 10 checks the 
minimum and maximum times (indicated by the Start time 
parameter) for pen strokes to be transmitted, in analogy 
with the minimum and maximum values of the Session 
counter parameter in the preferred embodiment described 
above. When a property page is then to be transmitted, 
the pen calculates a time window in accordance with the 
following. On the basis of the noted minimum time, the 
pen looks for the time in the reset list which most 
closely precedes the minimum time. This time defines the 
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start of the time window, while the noted maximum time 
represents the end of the time window. The reason for the 
earlier start of the time window is that otherwise one 
might possibly omit to transmit a property-selecting pen 
stroke which has been input as the very first event in a 
new working session. The above can be illustrated as 
follows . Now assume that : 

the reset list consists of the times: 

{12, 16, 19, 200, 330}, 

the normal pen strokes on the current page have the 
time stamps: 

{18, 21, 32, 100, 120, 230} and 

the property page contains property- selecting pen 
strokes with the time stamps: 

{l, 2, 3, 4, 6, 8, 9, 10, 12, 15, 20, 220, 500}. 

This gives minimum time = 18, maximum time = 230 for 
the normal pen strokes. The minimum time is preceded by 
a resetting at the time 16, which gives the time window 
[16, 23 0] . The following are thus transmitted to the 
server 5 : 

Normal pen strokes = {18, 21, 32, 100, 120, 230} 
(i.e. all of them) . 

Property-selecting pen strokes = {20, 200} (i.e. 
only the ones within the time window) . 

Resetting events = {16, 19, 2 00} (only those within 
the time window need to be transmitted to the server) . 

The subsequent processing/rendering takes place in 
substantially the same way as in Fig. 6; the three lists 
are combined to form a common chronological list in which 
a normal pen stroke is rendered according to the current 
rendering properties, a property-selecting pen stroke 
changes the rendering properties, while a resetting event 
resets the rendering properties to an initial or default 
state. 

Instead of transmitting a separate reset list to the 
server in accordance with the above, it might be possible 
to flag resetting events in the form of pen strokes using 
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a separate pre-defined meaning among the stream of normal 
pen strokes. 

According to yet another alternative embodiment, the 
noted session counter values and resetting times can be 
used for defragmenting or so-called garbage collection of 
the memory 16b in the pen, so that property- selecting pen 
strokes are kept in the memory only if there is at least 
one normal pen stroke with the same session counter 
value, or only if the property- selecting pen stroke has a 
time stamp falling within a time window which is relevant 
for the normal pen strokes stored in the memory (in ana- 
logy with the above description of an alternative embodi- 
ment) . 

The session counter may be incremented or otherwise 
updated in various other ways than the ones described 
above. For instance, the user may enter a certain second- 
type pen stroke to request initiation of a new working 
session, wherein the. session counter will be updated. 
Moreover, the pen may retrieve a control signal from an 
external device, such as the server 5, and. update the 
session counter accordingly. Alternatively, the session 
counter may be updated at a given periodicity, such as 
every ten minutes, every hour, etc. 

The embodiments described above involves a remote 
server 5 to which the registered pen strokes are 
transmitted for processing/rendering. As mentioned in a 
previous section of this document, however, the 
processing/rendering may alternatively, or additionally, 
be performed locally within the pen. Thus, the features 
of the invention in terms of handling of working sessions 
so as to achieve the objects and obtain the advantages of 
the invention are applicable to embodiments with local 
processing/rendering as well. 

Moreover, the embodiments described above primarily 
concern use of the second-type pen strokes as property- 
selecting pen strokes for normal (first -type) pen 
strokes. However, as mentioned in a previous section of 
this document, the second-type pen strokes may more 
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generally relate to instructions for the processing of 
the first -type pen strokes, or for the processing 
procedure itself. In addition to the examples of such 
instructions given in aforesaid previous section of this 
document, the second-type pen strokes may be used for 
indicating a desired interpretation context, either for 
subsequently entered (first-type) pen strokes in a 
certain working session or for all (first -type) pen 
strokes in a given situation (i.e., also previously 
entered ones) , viewed as individual pen strokes or as a 
whole. For instance, the desired interpretation context 
commanded by a certain second- type pen stroke may relate 
to a telephone number, wherein the relevant first -type 
pen strokes (for instance the ones that are subsequently 
entered during the current working session until another 
second- type pen stroke is given) will be interpreted as 
digits 0-9 and possibly certain other characters such as 
11 + " (for international dial code), "-" or "/"- 

Other examples of desired interpretation context may 
include a bank account number or another sequence of 
digits, an email address, a sequence of lower-case or 
upper-case characters, or a page format parameter such as 
page break, page columns or page margins. The desired 
interpretation context may also be that the (first-type) 
pen strokes in question are to be interpreted as 
character information (e.g. text) in general, instead of 
as pure graphical information. 

A second-type pen stroke may also be used for 
defining that information entered in a certain area of 
the writing base is to be interpreted in a certain 
manner, for instance as an ICR (Intelligent Character 
Recognition) field. Following such a second- type pen 
stroke, the certain area itself may be defined by a 
sequence of second- type pen strokes designating e.g. the 
four sidewalls or the four corners of a rectangular area. 
The position and extension of such a certain area may 
alternatively be hard-coded (predefined) , such that a 
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certain second-type pen stroke is always associated with 
a certain predefined area of the writing base. 

Such a certain area may alternatively be associated 
with an erasing operation, so that all entered pen 
strokes within the certain area are erased. 

Moreover, a second- type pen stroke may serve as an 
"access -granting" stroke to declare that various 
externally stored personal data (e.g. social security or 
personal number, telephone number, bank account number) 
may be used as input data when processing a certain set 
of pen strokes. 

All these alternative applications and meanings of 
second-type pen strokes may advantageously be used in 
conjunction with the other features of the invention, 
e.g. the af oredescribed handling of working sessions. 
They may, on the other hand, also be used without such 
handling of working sessions. 

Generally, everything that has been described herein 
as regards entering, processing, transmission and 
interpretation of first -type pen strokes in relation to a 
particular second-type pen stroke may involve first-type 
pen strokes following the particular second-type pen 
stroke during a current working session, and/or preceding 
first-type pen strokes in the current working session, 
entered on the same page or different pages of a writing 
base, including a hierarchical writing base as is 
disclosed in WO 01/48685, which is incorporated herewith 
by reference. 

The invention has been described above in the form 
of a couple of examples. However, the invention is not 
in any way limited to these, and instead it encompasses 
many other alternatives, as are defined by the scope of 
protection of the attached claims and will further be 
obvious to the person skilled in the art. 
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CLAIMS 

1 . An electronic pen for recording of handwritten or 
hand -drawn information, comprising 
5 a control unit (16a) ; and 

a memory (16b) ; 

wherein the control unit is arranged to register pen 
movements across at least one base (2, 2'), to store a 
plurality of digital pen strokes (1, 1') in the memory 
10 as a function of said movements, and to supply a set of 
the digital pen strokes for processing, and 

wherein the digital pen strokes include a first type 
(1) , which is intended to be processed as graphical 
information constituting said information to be recorded, 
15 and a second type (1'), which is intended to be processed 
as instructions for the processing of digital pen strokes 
of the first type, characterized in that 

the electronic pen comprises session-determining 
means (24, 25) adapted to detect a current working ses- 
20 sion of the pen, wherein 

the control unit (16a) is arranged to indicate, for 
the processing of said set of digital pen strokes (1, 
1')/ the working session during which the respective 
digital pen strokes have been input. 

25 

2. The electronic pen as claimed in claim 1, in 
which the control unit (16a) is arranged to cause only 
such digital pen strokes of the second type (1') to be 
processed, which originate from working sessions for 

30 which there are digital pen strokes of the first type (1) 
included in said set. 

3. The electronic pen as claimed in claim 2, further 
comprising a session counter (25) which is stored in the 

3 5 memory (16b) and which is incremented by the control unit 
(16a) when the session-determining means (24, 25) has 
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detected that a new working session has been initiated, 
the control unit (16a) being adapted to store the digital 
pen strokes together with the session counter values 
applying at the time of input of the respective pen 
5 strokes and being arranged to use these values when 

determining which digital pen strokes of the second type 
(1') are to be processed. 

4. The electronic pen as claimed in claim 2, in 
10 which the control unit (16a) is arranged to note the 

times at which new working sessions are initiated, store 
these times and use them when determining which digital 
pen strokes of the second type (1 # ) are to be processed. 

15 5 . The electronic pen as claimed in any one of the 

preceding claims, in which said session-determining means 

(24) comprises a mechanical, optical, electrical or 
magnetic switch which is connected to said control unit 

(16a) . 

20 

6. The electronic pen as claimed in claim 5, in 
which the pen comprises a pen body (11) and a protective 
cap, said switch being placed so as to detect that the 
protective cap is removed from the pen body. 

25 

7 . The electronic pen as claimed in any one of the 
preceding claims, intended to be used with a first base 
(2) for inputting digital pen strokes of said first type 
(1), and with a second base (2') for inputting digital 

30 pen strokes of said second type (1' ) . 

8 . The electronic pen as claimed in any one of the 
preceding claims, in which said base (2, 2') comprises a 
position-coding pattern. 

35 

9 . The electronic pen as claimed in any one of the 
preceding claims, in which said second type (!') of 
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digital pen strokes represents at least one property of 
said first type (1) of digital pen strokes. 

10. The electronic pen as defined in claim 9, 
5 wherein said property includes at least one of the 

following: a visual graphic property such as color, 
thickness, pattern or visibility; temporal or spatial 
resolution for the pen strokes; a background for the pen 
strokes; a context to which the pen or its user belongs, 
10 such as a certain user, group, company, shop, book, etc.; 
or an indication of restricted access to the pen strokes. 

11. The electronic pen as claimed in any one of 
claims 1-8, in which said second type (1') of digital pen 

15 strokes represents at least one command for affecting an 
interpretation of digital pen strokes of said first type 
(1) - 

12. The electronic pen as defined in claim 11, 
20 wherein said interpretation of digital pen strokes of 

said first type (1) includes character recognition and 
wherein said command serves to interpret a plurality of 
pen strokes as a text, a sequence of characters, a 
sequence of digits, a sequence of upper- case characters, 
2 5 a sequence of lower-case characters, or an address for 
electronic communication . 



13. The electronic pen as defined in claim 11, 
wherein said interpretation of digital pen strokes of 

30 said first type (1) includes geometrical object 

recognition and wherein said command serves to interpret 
a plurality of pen strokes as an ideal geometrical shape. 

14. The electronic pen as defined in claim 11, 
35 wherein said interpretation of digital pen strokes of 

said first type (1) includes character recognition and 



NSOOCIO: <W0 03046708 A1_L> 



BNS page 30 



. WO 03/046708 



PCT/SE02/02200 



10 



29 

wherein said command serves to define a page format 
parameter such as page break, page column or page margin. 

15. The electronic pen as claimed in any one of the 
preceding claims, further comprising a transmitter (18) 
for communication with a remote processing device (5) 
wherein the control unit (16a) is adapted to supply said 
set of digital pen strokes to said remote processing 
device for processing therein. 



16. The electronic pen as claimed in any one of 
claims 1-14, further comprising local processing means in 
said pen, wherein said local processing means is adapted 
to perform the processing of said set of digital pen 

15 strokes. 

17. The electronic pen as defined in claim 16, 
wherein said local processing means is implemented by 
said control unit (16a) . 

20 

18. The electronic pen as defined in claim 9 and 16, 
wherein said local processing means (16a) is adapted, 
when processing said set of digital pen strokes, to 
detect that a certain digital pen stroke is indicated as 

25 having been input during a different working session than 
a preceding digital pen stroke and, as a consequence of 
this, to restore the property for successive digital pen 
strokes of the first type (1) to an initial or default 
state . 

30 

19. A system for electronic recording of handwritten 
or hand-drawn information, comprising: an electronic pen 
(10) which is intended to be moved in desired pen move- 
ments (1, l') across at least one base (2, 2') and to 

35 register the pen movements as a plurality of digital pen 
strokes; and a processing device (5) for receiving 
registered digital pen strokes from the electronic pen, 
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the digital pen strokes including a first type (1) , which 
is processed by the processing device as graphical in- 
formation constituting said information to be recorded, 
and a second type which is processed by the pro- 

5 cessing device as an indication of a property of digital 
pen strokes of the first type, characterized 
in that 

the electronic pen (10) comprises session-determin- 
ing means (24, 25) adapted to detect a current working 

10 session of the pen; 

upon transmission of the digital pen strokes (1, 
1') to the processing device (5), the electronic pen is 
arranged to indicate during which working session the 
respective digital pen strokes have been input; and 

15 upon processing of the digital pen strokes, the pro- 

cessing device is arranged to detect that a certain digi- 
tal pen stroke is indicated as having been input during 
a different working session than a preceding digital pen 
stroke and, as a consequence of this, to restore the pro- 

20 perty for successive digital pen strokes of the first 
type (1) to an initial or default state. ? 

20. The system as claimed in claim 19, comprising an 
electronic pen as claimed in any one of claims 1-18. 

25 

21. A method for recording of handwritten or hand- 
drawn information originating from the pen movements (1, 
1') of an electronic pen (10) which are registered as 
digital pen strokes, wherein the digital pen strokes 

3 0 include a first type (1) , which concerns graphical 

information constituting said information to be recorded, 
and a second type (1')/ which concerns instructions for 
the processing of digital pen strokes of the first type, 
characterized by the steps of 

35 a) detecting the working session of the pen during 

which the respective digital pen strokes are recorded, 
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b) determining the working session (s) during which a 
plurality of digital pen strokes of said first type were 
recorded; and 

c) supplying for processing only such digital pen 
5 strokes of said second type which have been registered 

during the working session (s) determined in step b) . 

22. The method as claimed in claim 21, wherein step 
a) is carried out by detecting that the electronic pen 
10 (10) is started or activated and, as a consequence of 
this, incrementing a working session counter (25) , and 
wherein a value associated with said working session 
counter is used when performing steps b) and c) . 

15 23. The method as claimed in claim 21, wherein step 

a) is carried out by detecting that the electronic pen 
(10) is started or activated and, as a consequence of 
this, recording a time at which this happened, and where- 
in this time is used when performing at least step, c) . 

20 

24. A method for processing of handwritten or hand- 
drawn information in the form of a plurality of digital 
pen strokes (1, 1' ) which have been registered by the pen 
movements of an electronic pen (10) and which include a 
25 first type (1) , which concerns graphical information 
constituting said information to be recorded, and a 
second type (I')/ which concerns an indication of at 
least one property of digital pen strokes of the first 
type, characterized in that a set of recorded 
30 digital pen strokes is processed as follows: 

a digital pen stroke of the second type (1') deter- 
mines a current property of digital pen strokes of the 
first type (1) ; 

digital pen strokes of the first type are assigned 
35 the current property; and 

if a certain digital pen stroke is indicated as hav- 
ing been recorded during a different working session of 



ISOOCIO: <WO 03046708A1 J_> 



BNS page 33 



WO 03/046708 



PCT/SE02/02200 



32 

the electronic pen than a preceding digital pen stroke, 
the current property is reset to an initial or default 
state . 



5 25. The method as claimed in claim 24, wherein said 

property of the digital pen strokes of said first type 
(1) , which is indicated by digital pen strokes of said 
second type (1'), includes: a visual graphical property 
such as color, thickness, pattern or visibility; temporal 
10 or spatial resolution for the pen strokes; a background 
for the pen strokes; a context to which the pen or its 
user belongs, such as a certain user, group, company, 
shop, book, etc.; or an indication of restricted access 
to the pen strokes. 



15 



20 



26. A computer program product which can be loaded 
into a memory (28) belonging to a processor (27) and 
which comprises program code for carrying out the steps 
as claimed in claim 24 or 25. 

27. Use of an electronic pen as claimed in claim 3 
or 4 for defragmenting or so-called garbage collection of 
the pen's memory. 
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